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Abstract: We introduce the notion of continuous invertibility on a compact 
set for volatility models driven by a Stochastic Recurrence Equation (SRE). We 
prove in this context the strong consistency and the asymptotic normality of the 
M-estimator associated with the Quasi-Likelihood criteria. We recover known 
results on univariate and multivariate GARCH type models where the estima- 
tor coincides with the classical QMLE. In EGARCH type models, our approach 
gives a strongly consistence and asymptotically normal estimator when the 
limiting covariance matrix exists. We provide a necessary and sufficient con- 
dition for the existence of this limiting covariance matrix in the EGARCH(1,1) 
model introduced in Nelson (1991). We exhibit for the first time sufficient con- 
ditions for the asymptotic normality of the estimation procedure used in prac- 
tice since Nelson (1991). 
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1. Introduction 

Since the seminal paper of Engle (1982) and Bollerslev (1986), the General Au- 
toregressive Conditional Heteroskedasticity (GARCH) type models have been 
successfully applied to volatility modeling. Nelson (1991) is the first attempt to 
introduce non linearity into volatility models with the Exponential-GARCH(l,l) 
type models. Since then, many other volatility models have been introduced: 
APGARCH of Ding, Granger and Engle (1993), GJR-GARCH of Glosten, Jagan- 
nathan and Rimkle (1993), TGARCH of Zakoian (1994), etc. Non linear volatil- 
ity models have been used extensively in empirical researches (see Brandt and 
Jones (2006) among many others) and financial industry. Not surprisingly, the- 
oretical investigations of EGARCH has attracted constant attention, see He, 
Terasvirta and Malmsten (2002), Harvey (2010) and Rodriguez and Ruiz (2009). 
However, the validity of the estimation procedures used empirically in Nel- 
son (1991) was not proved. Our study provides the first satisfactory answer to 
this open question for non linear volatility models including the EGARCH(1,1) 
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model. We give sufficient conditions for the estimator to be strongly consis- 
tent and asymptotically normal. Our approach is based on the natural notion 
of continuous invertibility that we introduce in a very general setting and thus 
will be applied in other models in future works. 

1 /9 

Consider a general volatility model of the form Xf = ■ Zf where Sf is the 
volatility and where the innovations Zf are normalized, centered independent 
identical distributed (iid) random vectors. The natural filtration J-f is generated 
by the past innovations (Zf , Zf _i, . . . ) . It is assumed that a transformation of the 
volatility satisfies some (possibly non-linear) SRE, i.e. there exist a function h 
and some J-t~i measurable random function ipt such that the following relation 

{h{i:,)h<t = MM^k))k<t-i,Oo) (1) 

holds. It is the case of all classical models of GARCH and EG ARCH types, ex- 
tensions of the simplest GARCH(1,1) and EGARCH(1,1) univariate models. Let 
us illustrate our propose in this introduction on these models (in the univariate 
case, the volatility is denoted cr^): 

GARCH(1,1): crf = <xo + Po^U + 70^^, (2) 
EGARCH(1,1): log{af) = ao + /^o log(c^_i) + (7oZf-i + '^olZf-iD- (3) 

One can rewrite (2) as an SRE driven by the innovations: of = ocq + (/3o + 
7oZ^_^ )cr2_^, i.e. !/^f (x, 0) = a + (^ + -(Zl_^ ) x. This SRE is used by Nelson (1990) 
to obtain the Lyapunov condition E[log(/5o + To^g)] < 0, necessary and suf- 
ficient for the stationarity. In general, the functional process {xpt) driving the 
SRE (1) is assumed to be a stationary ergodic process of Lipschitz functions. 
Such a SRE is said to be convergent when its solution is unique, non antici- 
pative (i.e. function of J-f at any time t) and its law does not depend on the 
initial values. This last property, also called the "stability" of the SRE, ensures 
the existence of the stationary process (Xf). It coincides with the ergodicity for 
Markov chains. Sufficient conditions (also necessary in the linear Markov case) 
for the convergence are the negativity of a Lyapunov coefficient and the exis- 
tence of logarithmic moments, see Elton (1990), Bougerol and Picard (1992) and 
Bougerol (1993). 

Assume that the model have a non anticipative, stationary solution with 
invertible volatility matrices Sf. Using the relation Zf = ILj"^ ■ Xf in ipf, it is 
possible to study a new SRE driven by the observations Xf 

(/i(2:^))fc<f = ,?)t((/z(ZO)t<f-i,0o). (4) 

Here (pt is an ergodic stationary process generated by (C/f_i), the sigma-field 
of the past values (Xf_i, Xf_2/ ■ ■ ■ )■ Th^ convergence of this new SRE is closely 
related with the notion of invertibility (i.e. the existence of a non linear AR 
representation of the observations) see Granger and Andersen (1978), Tong 
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(1993), Straumann (2005) and Straumann and Mikosch (2006). As previously, 
sufficient conditions for the convergence are the negativity of a Lyapunov co- 
efficient and the existence of logarithmic moments; These conditions are ex- 
pressed this time on (pi and not on ipi. For instance, we obtain from (2) that 
(pt{x, 6) = a + /5x + jX^_^ and the GARCH(1,1) model is invertible as soon as 
< ^0 < 1- For the EGARCH(1,1) model, we obtain from (3) that 

cj}t{x,e) = ci + + {jXt-i+S\Xt-i\)exp{-x/2). (5) 

This SRE is less stable than in the GARCH(1,1) model because of the exponen- 
tial function that explodes for large values. However, a sufficient condition for 
invertibility is given in Straumann (2005) under restrictions on the parameters 
(ao/ ^0/ 70/ ^o), see (14) below. 

In practice the parameter Oq is unknown and is estimated using the SRE as 
follow. An approximation of the SRE {h{gj^))^^f = 4't{{^{Sk))k<t-i>^) gener- 
ates recursively a forecast gt{6) of the volatility Sf using only the past observa- 
tions and the model at the point 9. Using Quasi-LIKelihood (QLIK) criteria to 
quantify the error of the volatility forecasting: 

nSn{e) = = t^-' (xj£{gtie))-'Xt+log{demgt{0)))) (6) 

f=i t=i 

the best forecast corresponds to the M-estimator 6„ satisfying 

0„ = argmingg0S„(0). (7) 

Under conditions ensuring the asymptotic regularity of S„ ( ■ ), 0« is a good can- 
didate for estimating 6q. By construction, the asymptotic regularity of S„( ) 
depends on the regularity of gt{-) and on the stability of the corresponding 
SRE. As 6q is unknown, Straumann (2005) imposed the uniform invertibility 
over the compact set 0: The SRE is assumed to be stable in the Banach space 
of continuous function on (with the sup-norm). The consistency and the 
asymptotic normality of 6n follows, see Straumann (2005) and Straumann and 
Mikosch (2006). However, the notion of uniform invertibility is too restrictive; 
the asymptotic normality of the EGARCH(1,1) model is proved in the degen- 
erate case j6o = only; there log(crj^) = ao + (7oZt_i + ^o|Zt_i|) which is not 
realistic. 

In this paper, we introduce the notion of continuous invertibility and ap- 
ply it successfully to the EGARCH(1, 1) model: the asymptotic normality of the 
procedure described above and used since Nelson (1990) is proved for the first 
time. The notion of continuous invertibility is a very natural one: the SRE is 
assumed to be stable at each point 9 E & and the functional solution {gt{-)) 
is assumed to be continuous. By definition, uniform invertibility implies the 
weaker notion of continuous invertibility. We give sufficient conditions (CI) 
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for continuous invertibility and check it on volatility model that are non nec- 
essarily uniformly invertible. We prove under (CI) and the identifiability of 
the model that 6„ is a strongly consistent estimator of Oq and that the natural 
forecast gti^t) of the volatility Zf is also strongly consistent. We prove that 0„ 
is asymptotically normal if moreover the limiting variance exists. The proofs 
are very general and also valid in the multidimensional case. In absence of 
uniform invertibility we use under (CI) new arguments following the ones of 
Jeantheau (1993) for the strong consistency and of Bardet and Wintenberger 
(2009) for the asymptotic normality. One crucial step in the proof is Theorem 2 
below which asserts the logarithmic moments properties of solutions of SRE. 
This results, by its generality is of independent interest for the study of prob- 
abilistic properties of solutions of SRE (also called Iterated Random Functions). 

The commonly used statistical procedure described above is only valid un- 
der (CI). Fortunately condition (CI) is automatically satisfied for all invertible 
GARCH and EGARCH type models known by the authors. The GARCH(1,1) 
model satisfied (CI) on all compact sets of [0, oo satisfying /5 < 1 where it 
is also uniformly invertible. The EGARCH(1,1) model satisfies (CI) on all com- 
pact sets of points that satisfy the invertibility condition (13). It is not uniformly 
invertible there but the statistical inference is still valid. Applying our approach 
to other models, we recover the results of Berkes, Horvath and Kokoszka (2003) 
and Francq and Zakoi'an (2004) for GARCH(p,q) models, we recover the results 
of Francq and Zakoian (2011) for CCC-GARCH(p,q) models and for AGARCH(p,q) 
models we refine the results of Straumann and Mikosch (2006). On the contrary, 
it is shown in Sorokin (2011) that forecasting the volatility with SRE may be in- 
consistent when the SRE is unstable. Thus, if the model is not continuously 
invertible on the minimization (7) is unstable and the estimation procedure 
is not valid. To sum up, one can think of the following "equivalences": 



Stability of the SRE generated by 
the innovations (Zf, Zf_i, . . .) 




stationarity, ergodicity 
and log-moments 


Stability of the SRE generated by 
the observations (Xt,Xf_i, . . .) 




invertibility, forecasting 
and statistical inference 



The equivalence (A) is crucial when studying existence of stationary solu- 
tions of volatility models. We want to emphasize the importance of the second 
equivalence (B) for the volatility forecast and the statistical inference using the 
QLIK criteria. For non uniformly invertible models, it is crucial to infer the 
model only in the domain of invertibility otherwise the whole procedure can 
fail. The consequences of this work on empirical study is huge as the equiva- 
lence (B) has been negligible in most existing works, see Cai and Wintenberger 
(2011) for the EGARCH(1,1) case (applications on other classical models are 
also in progress). Finally, notice that the statistical inference of Oq is possible 
without assuming (CI): it has been done by Zaffaroni (2009) using Whittle's 
estimator. 

An outline of the paper can be given as follows. In Section 2, we discuss 
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the standard notions of invertibility and introduce the continuous invertibility 
and its sufficient condition (CI). In Section 3 our main results on the statistical 
inference based on the SRE are stated. We apply this results in some GARCH 
type models and in the EGARCH(1,1) model in Section 4. The Appendix con- 
tains the technical computation of the necessary and sufficient condition for 
the existence of the asymptotic variance of 6„ in the EGARCH(1,1) model. 

2. Continuously invertible volatility models 

2.1. The general volatility model 

In this paper, (Zf) is a stationary ergodic sequence of real vectors called the in- 
novations. Let us denote J-f the filtration generated by (Zf, Zf_i, . . .). Consider 
the general volatility model Xf = ■ Zf where (1) is satisfied: (/!(Sj;))it<f = 
\pt{{h{ll]f))l^^t_i,6Q). The function h is injective from the space of real matri- 
ces of size A: X A: to an auxiliary separable metric space F. The random function 
xpt{-, 9o) is a Tf^i adapted random function from the space of the sequences of 
elements in the image of h to itself. Let us denote £ the inverse of h (from the 
image of h to the space of real matrices of size kxk) and call it the link fimction. 

2.2. Convergent SRE and stationarity 

A first question regarding this very general model is wether or not a stationary 
solution exists. As the sequence of the transformed volatilities (^(Sj^))j;<f is a 
solution of a fixed point problem, we recall the following result due to Elton 
(1990) and Bougerol (1993). Let (E, d) be a complete separable metric space. A 
map / : E ^ E is a Lipschitz map if A(/) = su'p{xy)eE'^ '^(/(^)'/(]/))/^(^'y) 
is finite. For any sequence of random element in (E, d), (Xf ) is said to be expo- 
nential almost sure convergence to Xf as f ^ 00 if for Xf = o{e-^*) 
a.s. for some C > 0. 

Theorem 1. Let (Tf) be a stationary ergodic sequence of Lipschitz maps from E to E. 
Suppose that 'E[log^id{Yo{x),x))] < oo for some x e E, tto E[log+ A(Yo)] < oo 
and that for some integer r > 1, 

E[logA(TW)] =E[logA(Yoo...oT_,+i)] <0. 

Then the SRE Xf = Yf(Xf_i) /or all t & Z is convergent: it admits a unique station- 
ary solution {Yt)t£z which is ergodic and for any y & E 

Yf = lim Yf o ■ ■ ■ o Yf_m(v), t e Z. 

m->oo 

The Yt are measurable with respect to the (j(Yf_j., A: > 0) and 



rf(Yf,Yf) -^^0, t^oo 
such that Yt = Yf (Yt_i)/orflH t > 0. 
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The sufficient Lyapunov assumptions ]E[logA(YQ )] < is also necessary 
in the Unear case, see Bougerol and Picard (1992). 

The results of Theorem 1 does not guaranty any moment property on the 
stationary solution. The following result ensures the existence of logarithmic 
moments of the stationary solution under natural assumptions. It extends the 
result of Alsmeyer and Fuh (2001) to a much more general context. 

Theorem 2. Under the assumptions of Theorem (1) and E[(log^ d(Yo(x),x))^] < 
00 the unique stationary solution satisfies ]E[log'*"(d(Yo,i/))] < oo for all y & E. 

Proof. The basic inequality log(l + y + z) < log(l + J/) + log(l + z) will be 
used several time. Notice that for any r.v. X > we have the equivalence 
E[log(l + X)] < 00 iff E[log+(X)] < 00. Thus E[log(l +rf(Yo,y))] < oo for 
ally e E iff E[log(l + rf(Yo,x))] < oo since rf(Yo,y)) < d{Yo,x)) + d{x,y). 
We denote Tt-™) = Tq o ■ ■ ■ o Y_,„(x), w = d{y,Y^^''"\x)) > and z = 
A(Y(l-"'))d(Y_„,(x),x) > 0. From the triangular inequality d(x,Y(-"')(x)) < 
w + z we obtain that 

log(l + d(x,Y(-'")(x))) < log(l + a; + z) < log(l + a;) + log(l + z). 

Eqn. 27 in Bougerol and Picard (1992) asserts the existence of < p < 1 and 
e > satisfying 

lEi{„^oo-log(A(Y(-'"))) < log(p) -e a.s. 
m 

Thus there exists a r.v. M e N* such that A(Y("'")) < for all m > M. 
Writing = log(l + d(x,T(-'")(x))), for all m > M we have: 

Vm < I^m-l +log(l +p'"-^d(Y_„,(x),x)). 

A straightforward recurrence leads to the following upper bound of all (cm )m>M 

oo 

Vm < VM+J2^0g{l+pj-^d{W_j_M{x),x)). 

As log(l + d(x, Yg)) = limm^oo a.s., it remains to prove that the series in 
the upper bound is summable and that the upper bound is integrable to con- 
clude by the dominated convergence Theorem. Using the stationarity of {vm), 
we know that E[log{l + p'-^d{f_j_Mix),x))] = E[log(l + p^'"^d(To(x),x))] 
does not depend on M and Thus E[57m] = E[log(l + rf(x, Yo(x)))] < oo by 
assumption. We conclude the proof by comparing the series with an integral: 

E Eiiogd + ,M,(^„(,), .))] < ^ /■ W±^^ffoM^,,, 

j>l I p JO u 
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Let us prove that his integral converges as soon as E[(log~'' d(To(x),x))^] < oo. 
Using that E[log(l + Md(Yo(x),x))] = JJ" P(log(l + Mrf(Yo(x),x)) > t)dt and 
denoting v = [e* — 1) /u the integral becomes: 

I '~P(log(l+«d(T„()r),i))>f)jj^^^ /-° P(d(ToW,)r)>i.) ^.^^^ 



JO io 



" Jo io 1 + uv 

Using Fubini's theorem and Jg^ (1 + uv)~^du = \o^{v + l)/v for all c > we 
get an upper bound in term of 

log(l + z;)F(rf(To(x),x) >v) ^^^ 
Jo V 

This integral converges in +oo as 

J- log(l+.)F(rf(To(x),x)>.)^^ ^ ^^^^^^^ ^ 

and the desired result follows. □ 

In order to apply Theorem 1 in our case, let us denote by £ the separable 
metric space of the sequences of elements in the image of h. Equipped with the 
metric J2j>i2~id{xj,yj)/ {1 + d{xj,yj)), the space £ is complete. A sufficient 
condition for stationarity of (Xt) is that the SRE driven by (i/^t) converges in 

£. It simply expresses as the Lyapunov condition E[log A(iPq'^'')] < for some 
integer r > 1 and some logarithmic moments. This assumption of stationarity 
is sufficient but not optimal in many cases: 

Remark 1. The state space of the SRE (1), denoted E, in its most general form, 
is a space of infinite sequences. However in all classical models we can find a lag 
p such that {h{i:^))t-p+\<k<t = '/'t((^(^fc))t-p<fc<f-i/^o)- The state space E is 
now the finite product ofp spaces. It can be equipped by unbounded metrics such that 

p~^ I^yLi '^i^jrVj) o?" \jYJj=i ^^{^i'V])- The product metric has to be carefully chosen 
as it changes the value of the Lipschitz coefficients of the cpt. Yet, even if the prod- 
ucts spaces are embedded, the smallest possible lag p in the SRE yields the sharpest 
Lyapunov condition. Finally, ifE has a finite dimension and if the condition of conver- 
gence of the SRE expresses in term of the top Lyapunov coefficient, one can choose any 
metric induced by any norm, see Bougerol (1993) for details. 

In view of Remark 1, instead of choosing a specific metric space (£, d) we 
prefer to work under the less explicit assumption 

(ST) The process (Xf) satisfying (1) exists. It is a stationary, non anticipative 
and ergodic process with finite logarithmic moments. 

In view of Theorem 2, it is reasonable to require that the solution has finite 
logarithmic moments. It is very useful when considering the invertibility of 
the general model, see Proposition 2 below. 
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2.3. The invertibility and the observable invertibility 

Now that under (ST) the process (Xf ) is stationary and ergodic, we investigate 
the question of invertibility of the general model (1). We want to emphasize 
that the classical notions of invertibility are related with convergences of SRE 
and implied by Lyapunov conditions. Following Tong (1993), we say that a 
volatility model is invertible if the volatility can be expressed as a function of 
the past observed values: 

Definition 1. The model is invertible if the sequence of the volatilities (Sf ) is adapted 
to the filtration {Gt-i) generated by (Xf_i,Xf_2, ■ ■ ■ )■ 

It is natural to assume invertibility to be able to forecast the volatility and 
to ensure the so-called "predictability" of the model. This notion of invertibil- 
ity is very weak and consists in restricting the underlying filtration (J-f ) of the 
SRE to (Gt-i)- Indeed, under (ST) the filtration Qt Q is well defined. If the 
volatility matrices are invertible, using Zf = ■ Xf in ipt we can express (1) 
as (4): (^(Sj-))/c<f = (^t((^(S(i:))j;<t_i, Sq)/ a SRE driven by the whole past of the 
observations. The sequence of random functions {(pt)^^ an ergodic and station- 
ary process adapted to {Gt-i)- Using the sufficient conditions of convergence 
of SREs given in Theorem 1 , the invertibility follows if the ( ■ , 0o ) are Lipschitz 
maps such that for some x G £ and r > 0, 

E[log+(d(x,<|)o(x,0o)))] < ~, E[log+ A(</)o(-,0o))] < ~ 

and E[logA(</)o(-,0o)(''))] <0. (8) 

The Remark 1 also holds for the SRE driven by {(pt): the metric space (£, d) 
must be chosen carefully. The conditions (8) (with the optimal metric space 
(E, d)) are called the conditions of invertibility. 

Proposition 1. Under (ST) and (8), the general model (4) is invertible. 

Another notion of invertibility is introduced in Straumann (2005). We call it 
observable invertibility. As (pt {x, 9) = cpg ^ (Xf, Xf_i, . . .) where (pg ^ is measur- 
able for any x, 6, denote {x,0) = (pg -^ (Xf, . . . , X^, u) where u is an arbitrary 
deterministic sequence of E"^. 

Definition 2. The model is observably invertible if and only if the SRE 

{h{t,,))k<t = h{{H^k))k<t-i,Oo) t>l (9) 

is convergent for any arbitrary initial values /z(£ji-))j;<o ^"'^ swc/i that l|£f — St 1| — > 
in probability as t ^ oo. 

Notice that in general the approximative SRE does not fit the conditions 
of Theorem 1 and in particular (^f) is not necessarily stationary and ergodic. 
However, the Proposition below gives sufficient conditions for observable in- 
vertibility. It is a very useful result for the sequel of the paper, see Remark 2. 
Notice that logarithmic moments are assumed and Theorem 2 is very useful to 
check this condition. 
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Proposition 2. If (ST) and (8) hold, if the link function i is continuous and it exists 

X e E such that d{^t{x),cj)t{x)) ^'"'^'> and A{^t{-,Oo) - (pt{-,Oo)) '^'^'^'> as 
t — > 00, then the model is observably invertible. 

Proof. One can extend the proof of Theorem 2.10 in Straumann and Mikosch 
(2006) written for Banach spaces to the case of the complete separable metric 

space (£, d). That d((^(Ej-))jt<t), {h{'L]f))]^^t)) ^'^'^'> follows from the proof 
of Theorem 2.10 in Straumann and Mikosch (2006) under the following as- 
sumptions: 

51 ]E[log^(d(x,(^o(^/^o)))] < 00 for some X E E, 

52 E[\ogA{(po{;eo))] < ooand]E[logA((;)o(-,0o)^''')] < for some r > 0, 
S2' E[\og+{d{y,{h{Zk))k<f))] < ~ for ally e E, 

53 d{4>t{x),(pt{x)) and A{4>t{-,eo) - (pt{-,eo)) as i ^ oo. 

The conditions S1-S2 are equivalent to the invertibility conditions (8). S3 holds 
from the assumptions in Proposition 2 and S2' follows from (ST). Finally, using 
the continuity of the projection on the first coordinate and the one of the link 
fimction £, the desired result follows. □ 

Remark 2. Classical models such that GARCH(p,q) or EGARCH(p,q) models satisfy 
an SRE for finite p lags (/z(Sfc))t_p+i<fc<t = (pti{h{i:,,))f_p<^<t-i'So) and for some 
(pt generated by only a finite of past observation (Xf_i, . . . , Xt_q). In this context, the 
approximative SRE coincides with the initial ones, i.e. one can choose = (pt for 
t > q. Therefore, conditions of Proposition 2 hold systematically; invertibility and 
observable invertibility are equivalent, i.e. they are induced by the same Lyapunov 
condition. As for any initial values of^t (for < t < q) the conditions of Proposition 
2 are satisfied, seeking simplicity we work in the sequel with = (ptfo^ all f > 1. 

2.4. The continuous invertibility 

Now we are interested in inferring the unknown parameter 6q. To that ends, 
we extend the notions of invertibility at the point Oq to the compact set used 
in the definition (7) of our estimator For the sake of simplicity, we assume in 
all the sequel that we are in the framework of Remark 2, i.e. (pt is observable 
for t > q and <^t = ^t- For any 6 E &, let us consider from the functional SRE 
of the form 

me))t-p+i<k<t = cpt{{gkio))t-p<k<t-ve), yt>i, (lo) 

with arbitrary initial values {gk{0))i-p<k<0- If the model is invertible for all 
6 E &, the function gt{-) is well defined and converges to gt{-), the unique 
stationary solution of (10). For statistical inference, the regularity of ^f(-) is 
required. We call uniform integrability the notion used in Straumann (2005) 
and Straumann and Mikosch (2006): 

Definition 3. The model is uniformly invertible on if and only if the SRE (10) fs 
convergent when considering it on the Banach space of continuous functions C(0). 
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This notion is too restrictive and we introduce the weaker notion of contin- 
uous invertibility as follows 

Definition 4. The model is continuously invertible on if and only if the SRE (10) 
is convergent for all e and the stationary solution gt{-) is continuous. 

We have seen that sufficient conditions for pointwise invertibility are classi- 
cally expressed in term of Lyapunov conditions. Let us consider models with 
parametric functions having continuous Lipschitz coefficients: 

(CL) For any metric spaces X, y and Z, a function f : X x y i-^ Z satis- 
fies (CL) if there exists a continuous function : 3^ IR+ such that 
A(/(-,y)) < A/(y)forallye3^. 

In this context, the uniform invertibility holds under the Lyapunov condition 
E[logsup0 A^"^' (0)] < 0. This condition is too restrictive to handle EGARCH 
type models because of the supremum inside the expectation. We introduce a 
sufficient condition (CI) for continuous invertibility in term of a weaker Lya- 
pounov condition than the preceding one: 

(CI) Assume that the SRE (10) holds with (pt satisfying (CL) for stationary 

(r) 

( A^, ) such that conditions there exists an positve integr r such that E [log A^J ( ^ ) ] < 

on the compact set 0. Assume moreover that E [supg log^ A^'j {9)] < oo 

and that there exists y E E such that E [supg log^ {d{(po {y, 0),y))] < oo. 

The condition (CI) implies the convergence of the SRE (10) for all G 0. If 
^0 G it implies the invertibility of the model as described in Subsection 2.3. 
It also implies the local uniform regularity of gt{-) and thus the continuous 
invertibility: 

Theorem 3. Assume that (ST) and (CI) hold. Then the functions gt{-) are continuous 
for all 9 & & and all i e Z. Moreover, for any 9 & & there exists an e > such that 
gt{0) satisfying (10) satisfies 

lim sup d{gt{e'),gt{9'))^0. (11) 

e'eB{e,e)nQ 

(r) 

Proof. Without loss of generality one can assume that E[logA^^ (0)] > — oo 
such that limK^ooE[logAj,''j(0) V (-X)] = E[logAj'j(0)] for any e 0. For 

any p > 0, let us write Al''V,p) = sup {A^^^ {6'), 9' E B{9,p) HQ}, where 
B{9,p) stands for the closed ball centered at 9 with radius p. Noticing that 
E[sup0 I logA^'J(0) V (— -K)|] < 00, using the dominated convergence Theorem 
we obtain limp^oE (log a1'''(0,p) V (-K)) = E(limp^ologAi''^(0,p) V (-K)). 
By continuity limp^g log ^1*^' {9, p) = log A^'^^ {9) and for sufficiently large K 

limE(logAW(0,p) V i-K)) = E(logAW((?) V < 0. 
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Thus, there exists an e > such that 

E{\ogAi'\e,6)) < E{\ogAi''\9,e) V (-K)) < 0. 

Let us now work on C(B(0,e) H 0), the complete metric space of continu- 
ous functions from B{9,e) n& to M. equipped with the supremum norm doo = 
supB{0,e)no'^- In this setting (gt) satisfy a functional SRE {gk)k<t = hi{gk)k<t-i) 
with Lipschitz constants satisfying 



Aco(^r(-)) < sup 



Si,S26C(B(e,e)nO) ^^00(51,82) 

- ^"P ^ 

- ^"P ^ ^ 

Sl,S2GC(B(0,e)n0) floolSl,S2j 

^^PB(e,e)n0 M'PI''^ ^'))doo (Si, S2) 

< sup '—^ — ^ 

Si,S2GC(B(e,e)nO) flooiSi,S2j 

< Al'''(0,e). 

As E[supg(g^^)n0log+(d(^t(y,0').y))] < E[sup0log+(d(</)t(y,0),y))] is finite 

andE(logA^''j(0)) < we apply Theorem 1. By recurrence (^t o ■ ■ ■o(^t_,„(^o) e 

C{B{9,£) n 0) is continuous in 6 and so is gt as the convergence holds uni- 
formly on B [6, e) H 0. It is true for any G and the result follows. □ 

3. Statistical inference under continuous invertibility 

Consider 9n = argmu-igg0Sn(0) the M-estimator associated with the QLIK cri- 
teria (6) where {gt) is obtained from the approximative SRE (10). 

Remark 3. The statistical procedure described here does not coincide with the Quasi 
Maximum Likelihood for non uniformly invertible models. For a detailed discussion in 
the EGARCH(1,1) case see Cai and Wintenberger (2011). 

3.1. Strong consistency of the parametric inference 

From now on, we assume that the innovations process (Zf ) is iid: 

(IN) The Zf are iid variables such that E[ZjZo] is the identity matrix. 

The next assumption implies that the volatility matrices are invertible and that 
the link function ^ is continuous: 
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(IV) The functions and log(det(i')) are Lipschitz satisfying det(£(5'o(0))) > 
C{6) for some continuous function C : (0, oo). 

Remark 4. The SRE criteria converges to the possibly degenerate limit 

S(0) = E[so(0)] =2-iE [xJ^(go(0))-'Xo + log(det[£(^o(0))]) 

Notice that S{6q) = 2-1E[ZJZo + log(det(S:o))] is finite under (ST), (IN) and 
(IV) because /!(So) has logarithmic moments and log(det(^)) is Lipschitz. It is a 
considerable advantage of the QLIK criteria: it does not need moments of any order to 
be defined in 6q. Even ifS{9) may be equal to +oofor 9 ^ 6q, it does not disturb the 
statistical procedure that defines as a minimizer. 

If the model is identifiable, the estimator d„ is strongly consistent: 

Theorem 4. Assume that (ST) and (CI) are satisfied on the compact set 0. If (IN) 

and (IV) are satisfied and the model is identifiable, i.e. gQ{9) = hi'Lo) iff 9 = 9q, then 
9n — ^ ^^0 CIS. for any 9q e 0. 

Proof. With no loss of generality we restrict our propose to G satisfy- 
ing the relation det{i{^t{- ,9))) > C{9) for all t < 0. We adapt the proof 
of Jeantheau (1993) and its notation s*t(0,p) = inf{sf(0'),0' e B{9,p)} and 
s*ti9,p) = mf{st{9'),9' e B{9,p)}. Let us recall Theorem 5.1 in Jeantheau 
(1993) : The M-estimator associated with the loss (6) is strongly consistent un- 
der the h5rpothesis H1-H6: 

HI is compact. 

H2 S„{9) S{9) a.s. under the stationary law Pg^. 

H3 S{9) admits a unique minimum for 9 = 9q m&. Moreover for any 9i ^ 9o 
we have: 

lim inf S{9) > S(0i). 

— 

H4 V0 e and sufficiently small p > the process {s^t{9,p)))t is ergodic. 

H5 V0e0,E0js,i(0,p)] > 

H6 limp^oEeJs,i(0,p)] =E[s,i(0)]. 

Let us check H1-H6 in our case. HI is satisfied by assumption. H2 is verified 
in two steps. First, by the e.a.s. convergence given by Theorem 3, arguments 
of Straumann (2005) and the Lipschitz properties of and log(det(^)) we 
obtain 

^f^ sup \st{9')-st{9')\^0 Pe,-a.s. 
" f=i B{e,£) 

Second we use that (sf ) is an ergodic sequence and Proposition 1.1 of Jeantheau 
(1993). As the Sf are bounded from below n^^ E"=i ^t{9) converges P^^-a.s. to 
S{9) (taking values in ]R U {+oo]) 

lt.\'t{9)-S{9)\^0 Pe,-a.s. 
" t=i 
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Combining this two steps leads to H2. The first part of H3 is checked simi- 
larly than in (ii) p. 2474 of Straumann and Mikosch (2006) and with the help of 
the Remark 4. Notice that S has a unique minimum iff E[Tr(So ■ ^{So{(^))~^) ~ 
log(det(So ■ ^{So{S))^^))] has a unique minimum. As this criteria is the inte- 
grand of a sum of the A, — log (A,) where the A,- are positive eigenvalues, we 
conclude under the identifiability condition from the property x — log(x) > 1 
for all X > with equality iff x = 1 . The second part is checked using the fact 
that 

lim inf S{9) > E[lim inf so{0)] = E[so(0i)] = S{9i) 

9 — y6i 6 — y9i 

where the first inequality was already used for proving Theorem 3 and the 
first equality comes from the local continuity of go ^rid L H4 is satisfied from 
the ergodicity of (sf). H5 and H6 follows from Theorem 3 that ensures the 
continuity of the function s^i and by the lower bounded assumption on det(i'), 
see Proposition 1.3 of Jeantheau (1993). □ 

3.2. Volatility forecasting 

From the inference of Oq, we deduce a natural forecast of the volatility £t = 
i{gt{Ot))-lt is strongly consistent: 

Theorem 5. Under the conditions of Theorem 4 then ||£t — || ^0 a.s. as t ^ oo. 

Proof. It is a consequence of Theorems 3 and 4 that assert the a.s. convergence 
of 6t toward 9q and the local uniform convergence of toward gt- Notice that 
for t sufficiently large such that 6t G B (0, e), a ball where the imiform Lyapunov 
condition E[log Aoo((/'t(-))] < is satisfied. Thus gt{Ot) — gt{dt) — >■ a.s. and 
by continuity of £ and gt and from the identification = i{gt{9o)) the result 
follows if gt{9t) converges to gt(0o)- For proving it, we use 

d(gK«^).^t(^^o)) < Aco(<^'t(-))rf(^f-i(^j).^f-i(^^o)) + a^t(^t) 

where wt(0t) = d('l'j(^t-i(^o), '?'f(^t-i(^o), ^o))- The quantity d(gt(et),gf(0o)) 
is upper bounded by vt satisfying the SRE of linear stationary maps Vf = 
Aoo{(pt{-))vt-i + ivt{0t). We apply Theorem 1 as E[log(Ac«((^)f (■)))] < and 
Elog+(zi;o(0O) < E[sup0log+(2d(</)t(y,0),y))] < Weget 

OO 

i=0 

Conditioning on {6t), the upper boimd is a stationary normally convergent 
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^ ■ 

!=0 

P( ^ Aeo(<?'o(-)) ■ ■ ■ A^{cp_,+,{-))w_i{9t) ^ I 



■ ;=0 
E 



^1 V _ 

= ]E[1] =1, 

the last inequalities following from the continuity of normally convergent se- 
ries of functions, 6t — )• Oq and Wi{0t) — )• Wi{9o) = for all i a.s. as f — oo. □ 

3.3. Asymptotic normality of the parametric inference 

Classical computations show that if the M-estimator 9„ is asymptotically nor- 
mal then the asymptotic variance is given by the expression 

V = P^QP-^ 

with P = E[Hso(0o)] and Q = E[Vso(9o)Vso(0o)^]/ where Hso(0o) and Vsq 
are the Hessian matrix and the gradient vector of sq{6q). 

( AV) Assume that E([|ZoZj|p) < oo and that the functions t and (pt are 2-times 
continuously differentiable on the compact set that coincides with the 
closure of its interior. 



The following moments assumptions ensure the existence of Q and P: 

(MM) Assume that E[||Vso(0o) IP] < oo and E[||Hso(0o) II] < <»■ 

These moments assumptions holds only for 9 = 6q; they are simpler to ver- 
ify than for the moment conditions for 6 ^ Oq due to the specific form of the 
derivatives of the SRE criteria at 6o, see Remark 4 for details. The next assump- 
tion is classical and ensures to the existence of P~^: 

(LI) The components of the vector Vgo(^^o) are linearly independent. 

o 

Let V = B{6(),e) c with Oq E& and e > chosen in accordance with The- 
orem 3, i.e. such that E[log(supy A^^)] < 0. The two next assumptions are 
specific to the SRE approach. They ensure that Vsf (0) is a good approximation 
of Vsf (0) uniformly on the neighborhood V of Oq: 

(DL) The partial derivatives = D.^.(^t), = Dg{cj)t), = Dl^{(pQ), Dl^{(po) or 

Dgii'Po) satisfy (CL) for stationary (A<j>j) with E[supy log(A(i,jj)] < oo. 

Assume there exists y E E such that E [supy (log^ (rf (i^o (j// ^')/]/)))^] < 
(LM) Assume thaty \/£^^{y) andy Vlog(det(^(y))) are Lipschitz func- 
tions. 
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Now that V is well defined in terms of derivatives of sg that are well approxi- 
mated by derivatives of the SRE, the procedure is asymptotically normal: 

Theorem 6. Under the assumptions of Theorem 4, (AV), (MM), (LI), (DL) and (LM) 

then the asymptotic variance V is a well defined invertible matrix and 

Vn{en-eo) An'{o,v) if 00 EQ. 

Proof. Under (CI) and (LM) we apply Theorem 2 to {supy gt (9)). We obtain 
E[log^ (supy go(^^))] < o^- From the Lipschitz condition in (DL) we have that 
E[supylos+{\\^om\)]<cs=tov^oiO) = Dgi4>o)igo{e),9)ovDl,{cpo)igoie),0) 
or Dg ^ {(po) {go {6),0) or {(po) (go (O), 6) . Using the existence of these logarith- 
mic moments and the relation E[log(supy A^g)] < 0, we apply recursively the 
Theorem 1 and prove the existence of continuous first and second derivatives 
of {gt{0)) on V as solutions of functional SRE. The asymptotic normality fol- 
lows from the Taylor development of Section 5 of Bardet and Wintenberger 
(2009) on the first partial derivatives V, of S„ 

V,S„(0„) - V,S„(0o) = HS„(6»„,/)(0„ - 0o) for all 1 < i < d. 

Then the asymptotic normality follows from the following sufficient condi- 
tions: 

1. n-i/2vs„(_0o) ^A/'(0,Q), 

2. \\n~^MS„{9„) — P|| converges a.s. to for any sequence converging 
a.s. to Oq and P is invertible, 

3. n-'^/^\\\/S„{e„) - VS„(0„)ll converges a.s. to 0. 

Due to its specific expression and Assumption (IN) the process {VSniOo)) is a 
martingale. Under (MM), the CLT for martingales applied to (VSn(^^o)) leads 
to the first condition. The first part of the second condition is derived from 
similar arguments than in the proof of Theorem 5 and an application of the Ce- 
saro mean theorem ensuring thatn-^\\MSn{e„) -E"=i^st{eo)\\ ^ a.s. The 
ergodic Theorem on (Hsf(0o)) with (MM) leads to ||m-^HS„(6'„) - P|| ^ 
a.s. The fact that P is invertible follows from (LI), see Bardet and Wintenberger 
(2009) for detailed computations. Finally the third condition is obtained by ap- 
plying Theorem 2.10 of Straumann and Mikosch (2006) to the SRE satisfied 
by (Vgt) and its approximative SRE satisfied by (V^t) uniformly on V. Thus 

supy ||V^t — Vgtll ^'^'^'> as f ^ 00 and Lipschitz conditions on V£~^ and 
V log(det(i?)) in (LM) and arguments similar than in Straumann (2005) leads 
to the desired result. □ 

4. Applications to GARCH and EGARCH type models 
4.1. Some applications to GARCH type models 

In GARCH type models, the stationarity assumption (ST) is crucial, whereas 
the continuous invertibility condition (CI) is automatically satisfied on well 
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chosen compact sets due to the form of the model (they are also uniformly 
invertible). The asymptotic properties of the QMLE (that coincides with the 
procedure described here in these cases, see Remark 3) follow from Theorems 
4 and 6. Thus, we recover and slightly refine existing results in the AG ARCH 
and CCC-GARCH models (we refer the reader to Straumann (2005) and Francq 
and Zakoian (2011) respectively for details). Moreover, we prove also for the 
first time the strong consistency of the natural volatility forecast in both cases 
under the conditions of strong consistency of On • 

First, let us detail the case of the univariate APGARCH(p, q) model intro- 
duced in Ding, Granger and Engle (1993), Zakoian (1994) and studied in Strau- 
mann (2005): 

P (J 
= ixo + J2^ii\^t-i\- l^t-if + E ^;^t-r * e ^' 

i=l ;=1 

where olq > 0, a,, /3y > and ItI < 1 (it coincides with the GARCH(p, q) model 
if 7 = 0. Then we derive the strong consistency and the asymptotic normal- 
ity directly from our Theorems 4 and 6. The conditions we obtained coincides 
with these of Theorem 5.5 and Theorem 8.1 of Straumann and Mikosch (2006) 
except their useless condition (8.1) as one does not need moment of any order. 

Second, let us consider the multivariate CCC-GARCH(p, (j) model intro- 
duced by Bollerslev (1990), first studied in Jeantheau (1998) and refined in 
Francq and Zakoian (2011) 

q p 

i=l i=l 



and = Pijy (^?)m(^?);,;) for all {i,]), where Diag{M) is the vector of the 

diagonal elements of M. A necessary and sufficient conditions for (ST) is given 
in term of top Lyapunov condition in Francq and Zakoian (2011). We recover 
the strong consistency and the asymptotic normality of Francq and Zakoian 
(2011) directly from our Theorems 4 and 6. 

4.2. Application to the EGARCH(1, 1) model 

Let (Zf ) be an iid sequence of random variables not concentrated on two points 
such that E(Zg) = 1. The EGARCH(1, 1) model introduced by Nelson (1991) is 
an AR(1) model for log of, 

Xt = atZt with log a} = ao + jSq log a}^^ + Wt_i (0o) 

where Wt(0o) = 7o-Zt + 5q |Zt| are the innovations of this AR(1) model. Let 
^0 = ('J^O/ /^O/ 70/ ^0 ) be the unknown parameter. Assume that | /5o | < 1 such that 
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there exists a stationary solution having a MA(oo) representation: 



oo 



(12) 



The moments assumptions on Zf ensures that the process {log cr^) is ergodic, 
strongly and weakly stationary. Then the volatilities process (of) is also ergodic 
and strongly stationary and (ST) holds. However, it does not necessarily have 
finite moment of any order. 

The invertibility of the stationary solution of the EGARCH(1, 1) model does 
not hold in general. A sufficient condition for invertibility is given in Strau- 
mann and Mikosch (2006). As (logcr^) satisfies the SRE 



if it has a non anticipative solution the model is invertible. Keeping the notation 
of Section 2, the function h is now the logarithmic fimction and the SRE (9) 
holds with {(j)f) defined by 



We check that the (pt are random functions generated by Gt-i- For any 6 E 
R X R+ X {7 > \S\} we restrict (^t(-; 0) on the complete separable metric space 
[a/(l — /5),oo) equipped with d{x,y) = \x — y\. The process {(pt{-;6)) is a sta- 
tionary ergodic sequence of Lipschitz maps from [a /(I — ^),oo) to [a /(I — 
^), 00) with Lipschitz coefficients 



A(</'Kv(^o)) <max{/3,2-i(7Xt_i+^|Xf_i|)exp(-2-ia/(l-/3))-/5}. 



The technical smoothness assumption (CL) is automatically satisfied as 



{A^,{e))t = (max(/5,2-i(7Xf_i + J|Xf_i|) exp(-2-ia/(l - /5)) - /5))t 



is a stationary process of continuous functions of 6. The EGARCH(1,1) is con- 
tinuously invertible on any compact set C R x R"*" x {7 > |^|} such that 



E[log(max{,6,2-i(7Xo + ^lXo|)exp(-2-ia/(l-^))-^})] < 0. (13) 



This sufficient condition for continuous invertibility depends on the distribu- 
tion of the observations (Xf). Notice that ifOg E & then it satisfies the condition 
of stationarity /3o < 1 and, from the MA(oo) representation (12) of log a^, our 
condition (13) expressed at Oq implies that 



logcrf = ao + ,60 log c^?_i + ((^oXf-i +7o|Xf_i|)exp(-log£r2_i/2), 



(pt{-,e) : s a + ^s + (7Xt_i+ J|Xt_i|)exp(-s/2) 



E log 




k=0 



X (7oZo + <5o|Zo|)-/5o}) 



< 0. (14) 
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It is the condition of invertibility of the EGARCH(1,1) model given in Strau- 
mann and Mikosch (2006). Applying our results of Theorem 4 and Theorem 5, 
we obtain 

Theorem 7. For any compact subset © o/R x 1R+ x {7 > \6\} satisfying (13) then 
611 and — cr^ ^ a.s. asn ^ 00 with of = exp(gf (0„)) ifO^ e 0. 

Proof. The condition (CI) follows from E[log A((^t(, 6))] < by assumption of 
0andE[sup0logA(<^t(,0))] < 00 since E log |Xt_i| = E(log(7 + log |Zf_i|) < 
00 as log of has a MA(oo) representation (12) and Z is rntegrable. Moreover as 
log+(d(^o(O,0),O)) = log+ I a + (7X^1 + ^5|X_i|)| then fixing y = one has 
E[sup0(log+(d((/)o(y,0),y))'] <oo. 

In the EGARCH(1, 1) model the link function is the exponential function ^(x) = 
exp(x) and since we have logof > a/(l — 1/ i{x) = exp(— x) is a Lipschitz 
function (log(det(^)) = id is also a Lipschitz function). Moreover the volatility 
process {of) is bounded from below by C{9) = exp(a/(l — /5)). Finally, the 
identifiability condition ^o(^) = ^(^o) iff 6 = 6q is checked in Section 5.1 of 
Straumann and Mikosch (2006). □ 

Notice that the procedure is valid only if G satisfies (13). In practice, we 
suggest to optimize the QLIK criteria under the empirical constraint 

£ log(/3, 2-1 (7Xf + S\Xt\) exp(-2-ia/ (1 - ^)) - /3) < 0. 

Existing procedures does not constrain the model to be invertible. The corre- 
sponding empirical results are not asymptotically valid since the underlying 
SREs are not stable, see Cai and Wintenberger (2011) for evidences on simu- 
lations. Notice also that the strong consistency of 9n has already been proved 
in Straumann (2005) and Straumann and Mikosch (2006) under the uniform 
invertibility condition 

E[suplog(max{/5,2-i(7Xf_i +J|Xt_i|)exp(-2-ia/(l -^)) -/3})] < 0. 


We share the appreciation of the authors that this condition is very restrictive 
and might not be satisfied for reasonable compact sets with /5 7^ and non 
empty interior. 

As a corollary of Theorem 6 we get the asymptotic normality of the statis- 
tical inference in the EGARCH(1, 1) model. The only existing result was Theo- 
rem 5.7.9 of Straumann (2005) valid only for degenerate EGARCH(1,1) models 
with j6 = 0. Our result holds under consistency assumptions and the following 
necessary and sufficient condition for the existence of V: 

(MM') E[Z4] <«3andE[(^o-2-i(7oZo + ^o|Zol)^] < 1- 

Theorem 8. Assume that assumptions of Theorem 7 are satisfied and that (MM') 

holds. Then ^n{Qn — Sq) Af{0,Y) where V is an invertible matrix if 6q £0. 
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Proof. By definition, {(pt) is 2-times continuously differentiable and simple com- 
putations give D.^.(<|)t)(x,0) = ^-2-i(7Xf_i+<5|Xf_i|)exp(-x/2),D0(</)t)(x,0) = 
(1, X, Xt_i exp(-x/2), |Xt_i I exp(-x/2))^, D^, (cpt) {x, 0) = 4"! (tX^^i +S\Xt_i \ ) 
exp(-x/2),D2g(</)t)(x,0) = (ai,2-iXf_iexp(-x/2),2-i|X,_i|exp(-x/2))^ 

and Dg2(^t)(^/^) = 0. Moreover, as the link function is i{x) = exp(x) is also 
2-times continuously differentiable, the last assertion of the condition (AV) of 
Theorem 6 holds, liie fact that (MM) holds iff (MM') holds is technical and 
postponed to the Appendix. The fact that (LI) holds if Zq is not concentrated on 
two points is classical, see for instance Lemma 8.2 of Straumann and Mikosch 
(2006). Assumption (DL) is satisfied from the expressions of the derivatives 
(that are Lipschitz functions) and as all the logarithmic moments are finite due 
to E[log(X^_2)] < 00. Finally (LM) is automatically satisfied due to the specific 
expression of the link function. Thus Theorem 6 applies. □ 
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Appendix: (MM) holds in the EGARCH(1,1) model iff (MM') holds 

To check (MM) is technical as we have to compute explicitly the diagonal terms 
the matrix B = gt{9Q) (V gtiOo))'^]. Similar computations have been done 
in Demos and Kyriakopoulou (2009). Remember that V = P^^QP^^ with P = 
E[Hso(0o)] andQ = E[Vso(0o)Vso(0o)^]- Let us first prove the three identities 
P = 2-1b, Q = (EZ^ - 1)B and thus V = (EZ^ - l)B-i. For the first 
identity, we compute 



= 4-iE[(l - Zlf]E[Vgt{eo){Vgt{eo)f] = 4-i(EZ4 - 1)B 

and the third identity follows the first ones. Thus, for checking the assumption 
(MM), it is enough to check that diagonal coefficients B/, are well defined when 
E(Z^) < 00. Let us denote Wf = jqZi + 3o\Zt\, Ut = {l,logaf,Zt,\Zt\) and 
Vt = ^o- (ToZf + So\Zt\). Then {Vgt{Oo)) is the solution of the linear SRE 




Q = E [1e [vgtieo)iVgt{eo)V{i - 'Af\ l-^^-i 




Using the convention n^=i ^t-k ~ 1/ we obtain the expression 




More precisely, we have the expressions: 



then 




To prove that condition (MM) is satisfied, i.e. that E/=i B/, < 00, we use the 
following Lemma 
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Lemma 1. J^f^-^ B;,- < oo iffEV^ < 1. 

Proof. That the first coefficient Bn is finite comes easily from the identities 

00 l — l oo 00 I — I l' — 1 

Bn = E(E n Vt-k)' -^LLU Vt-k n Vt-k') 

l=lk=l l=li'=ik=l k'=i 

oo l — l oo / —1 oo l — l 

^ E(2 uu vt-kf E n Vt-ic' + E E(n 



1 



l-EVo 1-Ey2 

EVo 1 

X - — ^ + 



I-EVq^ 1-EVo 1-EVo2- 

For the second coefficient B22, it is more complicated. We need some prelimi- 
nary work. We know that Wt — jo^t + ^0 |Zf | — 2(j6o — Vt), and 

logoff ^ + t ^0-^ = - 2 E 



so, we decompose B22 into three parts, 

2 

CO f — 1 

B22 =E 



00 /-I 

Eiog'^'-zn^f-zc 
/=i fc=i 



=E 



/-I 



E(^-2E/3rv.-.-.in^.-.' 



_l= 

^ l-i6o 



E 



■ 00 1-1 

E n 



1 - po 



+ 4E ^ 

'1=1 k=l 

CO 00 / — I 



00 00 l — l 



)fc'=i 



That the first term of the sum is finite is already known. For the last term, it is 
straightforward from EE;iiEr=iiSo"'^f-/-)fcn[7^, V^.^' = {1 - M'^BVo / {1 - 
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l-l 



-I 2 



OO 00 / — I /'—I 

!<;<;' <ooiM=i p'=i 

CO OO / — I 

+ E E n 

!</</' <ool<P«/«» p'=l <j'=/ 

~ . ''-1 

+2X E E n n 



l</</'<ooP=l 



p X J. f_p X J. t-<? 

p =1 <| =/ 



OO OO / — I 

+ 2 E E -'^.-/-p^.-/-, n yi,' + E E /^o''" n n./ 

;=ii<p<q<oo p'^i ^ /=ip=i p'=i ^ 



and in expectation we obtain a boimded term if EVq < 1: 



E 



CO 00 l — l 

EEr^^*-/-.nn-. 



1 - EV(2 



+ 4 X 



/3o EVq 1 EVp/j 

(1 - /3o)(l - 151) 1 - EVo (1 - iSo)(l - iS^o) 1 - ^l^Vo 



(l-/3o)(l-/32)(l-/52Eyo)l-IEV2 



+ 2 X 



+ 2 



Ey2 



l-;62i_]Ey2 



EVo 



EVo 



1 - EVb 1 - /SgEVo 



(EVo)^ 



l-EVi{l-^l)il-^lEVo) 



+ 2 



r(Eyo) 



/So 



+ 



EK^ 



l_]Ey2V ^i_^^^(i_^2) l_]Ey2i_^2 
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That Brtr, is finite imder EVn < 1 comes from 



B33 =E 



■ 00 i-i 

1=1 fc=i 



H 2 



00 00 1 — 1 I —1 00 / — I 



CO 

2 \~'('icT/2\;-l 



/=1 



=EZ2E(W2) 



EZ2 



1 -EVg^' 



That the last coefficient is also finite comes form the computation 

2 

B44 =E 



00 /-I 

EiZf-/in^t-fc 
/=i fc=i 



00 00 

.2EEEl2f-/l 

'=!;'>; 



/-I / -1 CO /-I 

n^^-fcn^t-.'+EEz?-/(nw 
fc=i fc'=i /=i fc=i 



=2EEE 



/ -1 



Vjt=l 



)c'=/ 



1 - EVg^ 



00 00 , IFZ^ 

.2 E E(E |Zo|)(Eyo')'-i(E |Zo| yo)]Ev^ -'-1 + ° 



2E|Zo|(E|Zo|yo) ^ EZ2 



1 - EVq^ 



■(i-Eyo)(i-Ey2) i-Ey2- 



